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(57) Abstract: The basic configuration of Single local Adaptive Window Spatial Noise Reducer (SAW-SNR 318) is based on a 
preliminary de-noising low-pass filter followed by homogenous region segmentation to the considered pixel in a given local window. 
The configuration is composed also of an adaptive local mean estimator (307), an adaptive local statistic estimator (312) which is 
preferably an economic standard deviation (SD) estimator and finally, a minimum-mean-square-error (MMSE) based de- noising 
technique. The proposed segmentation configuration outperforms existing spatial noise reducers in term of subjective and objective 
performances, in term of edge preservation, noise reduction in both homogenous regions or picture edges and Peak Signal to noise 
Ratio (PSNR). A second configuration in the form of a Parallel Multiple local Adaptive Window Spatial Noise Reducing apparatus 
(Parallel M-AW-SNR 800), is a combination of several basic reducers (312) which implements different segmented windows. The 
M-AW-SNR, which is the less complex configuration for multiple spatial noise reducers, reduces further residual noise as compared 
to the basic configuration of SAW-SNR (312). A third configuration combines the basic configuration of SAW-SNR (312) with 
a controllable noise variance estimator (9(X)). This generic configuration allows an adaptive local control of noise reduction level, 
which can be useful for some correlated noise such as ringing noise in DCT -based decompressed images or cross- luminance noise 
in composite decoded images. 
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APPARATUS AND METHOD FOR ADAPTIVELY REDUCING NOISE 
IN A NOISY INPUT IMAGE SIGNAL 

Field of the Invention 

5 The present invention relates to the field of image noise reducing, and 

more particulariy to apparatus and method for adaptively reducing noise in a noisy 
input image or a sequence of images, wherein the noise is of an additive 
Gaussian type. 
Description of the Prior Art 

10 While existing prior patents and other publications on noise reducing 

techniques are abundant, they generally concern coring, techniques applied in 
high frequency part of a considered image. Image de-noising techniques can be 
classified as spatial or temporal ones. Of course, a series combination of spatial 
and temporal techniques is possible and generally beneficial. 

15 Temporal filters are generally applied for a sequence of images in which 

the noise component between two successive images is supposed to be non- 
correlated. The temporal filtering techniques are essentially based either on 
motion detection or motion estimation. The filter structure can be either infinite 
impulse response (MR) or finite impulse response (FIR) with frame delay 

20 elements. In general, the temporal techniques are more performing than the 
spatial ones. The system cost is essentially due to the frame memory and the 
motion estimation hardware. Temporal de-noising techniques can be found, for 
example, in U.S. Patents No, 5,161,018 to Matsugana; U.S. Patent No. 5,191,419 
to Wicshermann; U.S. Patent No. 5,260,775 to Farouda; U.b. Patent No. 

25 5,404,179 to Hamasaki and in a recent publication entitled "The Digital Wetgate: 
A Third'Generation Noise Reducer^, Wischerman; G., SMPTE Joumal, February 
1996, pp. 95-100. 

Spatial noise reducing techniques can be applied for either still pictures or 
sequence of images. These techniques are described in many available textbooks 
30 such as: 'Tundamentals of Electronic Image Processing*', Weeks; A. R. Jr.. SPIE 
Optical Engineering Press, Bellingham, Washington, 1996; 'Two-Dimensional 
Signal and Image Processing", Lim; J.S., Prentice-Hall, Englewood Cliffs, NJ, 
1990; and "Nonlinear Digital Filters: Principles and Applications" , Pitas, J. and al., 
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Kluwer Academic Publishers, Boston, 1990. In general, spatial noise reducing 
techniques can be divided further Into three categories. 

In the first category, the spatial nonlinear filters are based on local order 
statistics. Utilizing a local window around a considered pixel, these filters are 

5 working on this set of pixels ordered from their mininnum to their maximum values. 
For example, the median filter, the min/max filter, the alpha-trimmed mean filter, 
and their respective variants can be classified in this category. These filters work 
well for removing impulse like salt-and-pepper noise. However, for the small 
amplitude noise these filters can blur some details or small edges. 

10 In the second category, the coring techniques are applied In another 

domain different from the original image spatial domain. The chosen domain partly 
depends on noise nature. U.S. Patent No. 4,163,258 to Ebihara teaches the use 
of the Walsh-Hadamard transfomi domain, while U.S. Patent No. 4,523,230 to 
Carlson etal. discloses some sub-band decomposition. Finally, the homomorphic 

15 filter, working in the logarithmic domain, is the classical one for removing 
multiplicative noise and shading from an image. 

In the third category, the filters are locally adaptive and the noise removing 
capacity is varying from homogenous regions to edge regions. These filters give 
good results for additive Gaussian noise. A well-known filter in this category Is the 

20 minimum-mean-square-error (MMSE) filter as originally published in 'Digital image 
enhancement and noise filtering by use of local statistics", Lee; J.S., IEEE Trans, 
on PAMI-2, March 1980, pp. 165-168. Referring Fig. 1, a general block diagram of 
the prior art Lee's MMSE noise reducer is illustrated. Let a fixed dimension 
window centered on the considered or current pixel. The filtered pixel output 

25 f'(x,y) is additively composed of the local mean value obtained at output 12 of a 
mean estimator 10 and a weighted difference of the noisy pixel g{x,y) and the 
local mean intensity values. The optimum weight K determined by MMSE at an 
output 14, which corresponds to a kind of coring technique. Is equal to the local 
variance ratio of the true image and the noisy one. The Lee's MMSE filter 

30 efficiently removes noise in homogenous image regions while reserving the Image 
edges. However, the noise essentially remains in edge or near-edge regions. 
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Moreover, the required variance calculation is expensive for hardware 
implementation. 

In ""One-dimensional processing for adaptive image restoration'', Chan; P. 
et al., IEEE Trans, on ASSP-33, February 1985, pp. 117-126, there is presented 
5 a method for noise reducing in edge regions. The authors propose the use, in 
series, of four (4) one-dimensional MMSE filters respectively along 0°, 45°, 90° 
and 135° directions. The obtained results are impressive for large variance noise. 
However, for small noise, the filter can blur some image edges. Moreover, the 
noise variance output estimation at each filter stage require costly hardware. 

10 For a same purpose, in "Digital image smoothing and the Sigma filter'', Lee; 

J.S-, Computer Vision, Graphics, and Image Processing-24, 1983, pp. 255-269, 
there is proposed a said Sigma filter as illustrated in Fig. 2. For noise removing, 
this filter calculates with a segmentation processor 16 using a local window of 
5x5 dimensions combined to a mean estirhator 18, the mean value of similar pixel 

15 intensities to that of a central considered pixel g{x,y), to obtain f*(x,y). A pixel 
in the window is said similar to the considered pixel if the intensity difference 
between these two pixels is smaller than a given threshold value. Usually, the 
threshold value is set equal to twice the noise standard deviation. For small 
noise, the Sigma filter works well, except for some pixels with sharp spot noise. 

20 For the latter case, J.S. Lee has suggested also, in a heuristic manner, the use of 
immediate neighbor average at the expense of some eventually blurred picture 
edges. Generally, the MMSE filters yield better objective results in term of peak 
signal to noise ratio (PSNR), than the Sigma filter. 

Independently to the Lee's contribution, U.S. Patent No. 4,573,070 to 

25 Cooper essentially discloses a Sigma filter for a 3x3 window. Moreover, in the 
same Patent, Cooper finally combines in a single configuration the said Sigma 
filter, an order statistic filter and a strong Impulse noise reduction filter. 

In the above-cited publication of A. R. Weeks Jr., there is described the 
adaptive double-window-modified-trimmed mean (DW-MTM) filter. This filter yields 

30 as output the trimmed mean value of similar pixel intensities to the median value 
in a local window. The adaptive DW-MTM filter is able to eliminate both salt-and- 
pepper noise and Gaussian noise but at the expense of filtered image blurring. 
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Flnally, for correlated noise such as ringing/quantified noise in Discrete- 
Cosine-Transform (DCT) based decompressed image or cross-luminance noise in 
NTSC/PAL decoded Image, there is still a need for a generic configuration or 
technique for implementing a real time noise reducer. 
5 Summary of the invention: 

It is therefore an object of the present invention to provide an apparatus 
and a method for adaptively reducing noise in a noisy Input image signal which 
provides spatial noise reduction in both homogenous and edge regions using a 
robust adaptive local segmented window, while preserving picture edges. 
10 Another object of an aspect of the present invention is to provide, via a 

local segmented window, a technique that can adaptively estimate local mean and 
local standard deviation or variance in a non-stationary environment of a picture. 

Yet another object of an aspect of the present invention is to provide an 
economic MMSE-based spatial noise reducer. 
15 Yet another object of an aspect of the present invention is to provide a 

combined spatial noise reducer in which multiple local segmented windows are 
considered. 

Yet another object of an aspect of the present invention is to provide a 
generic configuration for correlated noise variance estimator and for controllable 

20 mechanism of local noise reduction level. 

According to one or more of the above objects, from a main broad aspect 
of the present invention, there is provided an adaptive spatial noise reducer for 
reducing noise in a noisy input image signal, which noise reducer comprises a 
low-pass filter receiving the noisy input image signal to generate a noisy low- 

25 spatial frequency image signal. The apparatus further comprises a first pixel- 
based serial-to-parallel converter receiving the noisy low-spatial frequency image 
signal to generate a group of noisy low-spatial frequency image parallel signals 
associated with a locally considered pixel and according to predetermined pixels- 
window characteristics, a pixel-based - local window segmentation processor 

30 comparing values of the noisy low-spatial frequency image parallel signals 
associated with pixels included within the window with the locally considered pixel 
value to generate segmented local window parallel signals associated with 
selected pixels, and a counter generating a selected-pixels count signal. The 
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apparatus further comprises a second pixel-based serial-to-parallel converter 
receiving the noisy Input Image signal to generate a group of noisy input image 
parallel signals associated with the locally considered pixel and according to the 
predetermined pixels-window characteristics. The apparatus also comprises a 
5 mean estimator combining the noisy input image parallel signals with the 
segmented local window parallel signals and the selected-pixels count signal to 
generate a mean pixel value signal associated with the locally considered pixel, 
and a minimum-mean-square-error filter receiving the noisy input image parallel 
signals, the segmented local window parallel signals, the selected-pixels count 

10 signal and the mean pixel value signal to generate a noise-filtered output image 
signal according to an input noise statistic signal. 

Conveniently, the noise reducer further comprises a controllable noise 
statistic estimator including a high-pass two-dimensional filter receiving the noisy 
input image signal to generate a noisy horizontal/vertical high-spatial frequency 

15 image signal, and a third pixel-based serial-to-parallel converter receiving the 
horizontal/vertical high-spatial frequency image signal to generate a group of 
noisy horizontal/vertical high-spatial frequency image parallel signals associated 
with the locally considered pixel and according to said set of predetermined pixels- 
window characteristics. The noise statistic estimator further includes a statistic 

20 calculator combining the noisy horizontal/vertical high-spatial frequency image 
parallel signals with said segmented local window parallel signals and said 
selected-pixels count signal to generate a resulting noise statistic signal 
associated with the locally considered pixel, and a noise statistic estimator unit 
generating said input noise statistic signal from the resulting noise statistic signaL 

25 According to a further broad aspect of the invention, there is provided an 

adaptive apparatus for spatially reducing noise in a noisy input image signal 
comprising a plurality of parallel-connected adaptive spatial noise reducers as 
defined according to the main broad aspect of the Invention as set forth above, 
wherein each noise reducer is associated with a distinct set of said 

30 predetermined pixels-window characteristics and each noise reducer receives the 
noisy input Image signal to generate a corresponding said noise-filtered output 
image signal. The apparatus further comprises an averaging unit receiving each 
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noise-filtered output image signal at a corresponding positive input thereof to 
generate a resulting noise-filtered output image signal. 

According to another broad aspect of the invention, there is provided an 
adaptive apparatus for spatially reducing noise in a noisy Input image signal . 
5 . comprising a plurality of parallel-connected adaptive spatial noise reducers as 
defined according to the main broad aspect of the invention as set forth above, 
wherein there is only one said low-pass filter shared by all noise reducers, each 
said noise reducer being associated with a distinct set of said predetermined 
pixels-window characteristics, each said noise reducer receiving said noisy low- 

10 spatial frequency image signal to generate a corresponding said noise-filtered 
output image signal. The apparatus further comprises an averaging unit receiving 
each noise-filtered output image signal at a corresponding positive input thereof to 
generate a resulting noise-filtered output image signal. 

According to another broad aspect of the invention, there is provided an 

15 adaptive method for spatially reducing noise in a noisy input image signal 
comprising the steps of: i) filtering the noisy input image signal to generate a 
noisy low-spatlal frequency image signal; ii) converting the noisy low-spatial 
frequency image signal to a group of noisy low-spatial frequency image parallel 
signals associated with a locally considered pixel and according to a set of 

20 predetemnined pixels-window characteristics; iii) comparing values of the noisy 
low-spatial frequency image parallel signals associated with pixels included within 
the window with the locally considered pixel value to generate segmented local 
window parallel signals ."^sociated with selected pixels; iv) generating a selected- 
pixels count signal; v) converting the noisy input image signal to a group of noisy 

25 input image parallel signals associated with the locally considered pixel and 
according to the set of predetermined pixels-window characteristics; vi) combining 
the noisy input image parallel signals with the segmented local window parallel 
signals and the selected-pixels count signal to generate a mean pixel value signal 
associated with the locally considered pixel; and vii) processing the noisy input 

30 image parallel signals with a minimum-mean-square-error filter using the 
segmented local window parallel signals, the selected-pixels count signal and the 
mean pixel value signal to generate a noise-filtered output image signal according 
to an input noise statistic signal. 
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Preferably, the method further comprises the steps of: viii) repeating said 
steps ii) to vii) according to at least one further distinct set of pixels-window 
characteristics to generate a further noise-filtered output image signal according to 
the input noise statistic signal; and ix) averaging said output image signals to 
5 generate a resulting noise-filtered output image signal. 

Conveniently, the method further comprises between said combining step 
vi) and processing step vii) the steps of: a) filtering the noisy input image 
signal to generate a noisy horizontal/vertical high-spatial frequency image signal; 
b) converting the noisy horizontal/vertical high-spatial frequency image signal to a 

10 group of noisy horizontal/vertical high-spatial frequency image parallel signals 
associated with the locally considered pixel and according to the set of 
predetermined pixels-window characteristics; c) combining the noisy 
horizontal/vertical high-spatial frequency image parallel signals with the 
segmented local window parallel signals and the selected-pixels count signal to 

15 generate a resulting noise statistic signal associated with the locally considered 
pixel; and d) generating said input noise statistic signal from the resulting noise 
statistic signal. 

Brief description of the drawings 

The preferred embodiments of the present invention will now be described 
20 with reference to the accompanying drawings, in which: 

Fig. 1 is a general block diagram of the prior art Lee's MMSE noise 
reducer; 

Fig. 2 is a general block diagram of the prior art Lee's Sigma filter; 
Fig. 3 is a block diagram illustrating a first preferred embodiment of a 
25 spatial noise reducer according to the invention, in which a single local adaptive 
window is utilized; 

Fig. 4 illustrates some examples of window characteristics versus current 

pixel; 

Fig. 5 is a block diagram representing a pixel-based sequential-to-parallel 
30 converter; 

Fig. 6a is a graphic notation of a scalar product device; 
Fig. 6b is a specific example of a scalar product device implementing two 
vectors each having three (3) components; 
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Fig. 7 illustrates a functional detailed diagram of the first basic embodiment 
of Fig. 1 using scalar product devices; 

Fig. 8 is a general block diagram representing a second preferred 
embodiment of a spatial noise reducer according to the present invention, in the 
5 form of a parallel multiple local adaptive window spatial noise reducer; 

Fig. 9 Is a block diagram representing a third preferred embodiment of s 
spatial noise reducer according to the invention, which combines a single local 
adaptive window spatial noise reducer with a controllable noise variance 
estimator. 

10 Detailed description of the preferred embodiments 

Referring now to Fig. 3 a first embodiment of the present invention in the 
forni of a Single local Adaptive Window Spatial Noise Reducer (SAW-SNR) will be 
described. This basic configuration provides a segmentation-based MMSE spatial 
noise reducer for efficient edge preservation, and noise reduction in both 

15 homogenous or edges picture regions. The configuration can be also considered 
as a suitable combination of the Sigma and the MI\4SE filters. In the block diagram 
shown in Fig. 3, appropriate delays allowing signal synchronization required by 
the various operations of the signal processing are not represented, 
implementation of such delays being well known in the art. An example of such 

20 an implementation will be described later in reference to Fig. 7. A noisy image 
input signal g{x,y) at 301 , which is typically a luminance component of the image, 
is applied to the SAW-SNR generally designated at 318. The couple {x,y) 
represents the current coordinates of a considered pixel. The input signal g{x,y) 
is a noisy version of an original image /(x,y)- A noise component n{x,y) is 

25 supposed to be additive, zero mean and independent to the original image, i.e.: 

g{x.y) = f{x,y)'^n{x,y). 

(1) 

30 The purpose of a noise reducer is to provide a cleaned output signal f*{x,y) 
which should be as close as possible to the original and unknown signal f{x,y). A 
usual criterion is the minimum of mean square error; 
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J = wmEilf{x,y)-r{x,y)y) 

(2) 

5 in which the image output signal f'{x,y) is a linear combination of the noisy 
observed image input g{x,y) and a local constant value: 

r(x,y) = a{x,y)»g{x,y)+b{x,y). 

(3) , 

10 

Substituting equation (3) in equation (2) and minimizing the mean square error, 
the expression of /'{xyy) in equation (3) becomes: 

rix,y) = Kix,y)^gix,y)+ (l - K{x,y))* Mx,y) 

15 {4a) 

f'ix,y) = Mxyy) + K{x,y)»{g{x,y)-M{x,y)) 

(4b) 

20 wherein Mx^y) is the local image mean value of f{x,y) or that of g{x,y)and the 
weight K{x,y) Is determined by: 

K{x,y) = min(0,(cr^(x. J.)- ^„^))/(^^(x,y)). 
(5) 

25 In the latter equation, the symbol crg(x,y) denotes theJggdLjt^3|}^^''d deviation 
(SD) of the input image g{x,y), and or„ corresponds In tum to that of the noise 
signal n{x,y). Substituting these results into equation (2) yields the minimum 
value of the performance indices: 
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(6) 



In equation (6), the symbol tT}{x,y) denotes the local variance of the clean Image 
5 f{x,y). The two equations 4 and 5 imply the knowledge of the local mean //{x,y) 
.and the local SD crgix,y). Unfortunately, the latter values are generally unknown. 

They should be estimated by some suitable manner. 

In the Lee's MMSE filter, these values are calculated in a local fixed 
dimension window around the central pixel {x,y) as follows 
10 A^{x,y) = Y,T.siiJ>x,y)/Nj. 

(7) 

and 

(8) 

15 

wherein the summation are done over all i and j in the given local window, 
g{iyj'ix,y) being values of a group of noisy input image parallel signals, Nj. 
denoting the pixel total number in the window. In homogenous regions where 
pixels are similar, equation (7) yields generally good results'. However, in near 

20 edge or edge regions, the estimation given by equation (7), which does not take 
care of the non-stationary sigu^^', becomes en-oneous. In a similar manner, 
equation (8) can overestimate the signal variance in edge or near edge regions, 
the weight K{x,y) in equation (5) becomes unity (1) and the system given by 
equation (4) does not reduce any nniore noise in such cases. Moreover, the square 

25 values in equation (8) imply many expensive multipliers in an hardware 
implementation. 

Meanwhile, in the Lee's Sigma filter, the weight K{x,y) is set to be fixed 
and equal to zero (0), which imply that the Sigma filter is always sub-optimum, 
and the mean value estimation is calculated only with selected similar intensity 
30 pixels in the window, that is: 
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(9) 



(10) 



wherein the summation are done again over all i and j In the given local window, 
N bein a value of said selected-pixels count signal. However, in order to 
10 .consider both homogenous and non-homogenous regions, the pixel intensities 
gii,J;x,y) are weighted by window binary signals M{i,j;x,y) defined as follows: 



wherein g{x,y) = g{o,0;x,y) is the intensity of the window central and considered 
pixel, T being a predetermined threshold value. The suggested threshold value 
in Sigma filters is equal to 2cr„ . The higher the threshold value T , the more noise 
is reduced, but at the expense of bluning tme small image edges. If the threshold 
20 value T is small, equation (1 1 ) will leave unchanged Isolated strong spot noise. 



low pass (LP) filter 302. The low pass filter 302 plays a very important role by 
partly reducing strong spot noise. Its output g'{x,y) allows robust segmentation 
25 in the presence of noise. For additive noise, it can be a simple filter with impulse 
response function ^(x,;v) described by the following matrices: 




(11) 



In order to combine the main advantages of Lee's MMSE and Sigma filters, 
the noisy input signal g(x,y) shown at 301 in Fig. 3. is firstly fed to a preliminary 
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'1/9 1/9 1/9' 
lpix,y)= 1/9 1/9 1/9 
1/9 1/9 1/9 



(12a) 



or 



"1/16 2/16 1/16 
Ip{x,y)= 2/16 4/16 2/16 
I1/I6 2/16 1/16 



(12b) 



The filter output g'ixyy) 303 is sent to a first pixel-based serial-to-parallel 
converter (PB-SPC) 306 receiving the noisy low-spatial frequency image signal to 



with a locally considered pixel and according to predetemnined pixels-window 
characteristics, which parallel signals generated at 303' are fed to a pixel-based 
local window segmentation processor 304 that selects pixels in a local window 
which are similar to the considered cunrent pixel. An implementation example of a 
15 PB-SPC will be described later with reference to Fig. 5. The segmentation woricing 
with filtered image, yields at its output 320 a set of window binary signals 
yv{i,J;xyy) defined now as: 



wherein: -• - 

g''{i,j;x,y) is the values of the noisy low-spatial frequency Image parallel 
signals associated with pixels included within the window with 

/ = -k = -m,...,+n , the window having dimensions of {k + l)x{m + n), k,Um,n 

25 being appropriate positive integei^ ; 



generate a group of noisy low-spatial frequency image parallel signals associated 




20 



(13) 



g'{x,y) is the locally considered pixel value; and 
r is a predetermined threshold value. 
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Since the noise component in tfie filtered image g''(x,y) is reduced, tlie threshold 
value T fed at an input 305 can be also reduced. Practically, the threshold value 
T can be set to cr„ or usually to a fixed value selected finom 8 to16 in an eight (8) 
5 bits video system, if noise is weak enough. The original noisy image signal 
g {x,y) at 301 is sent to a second PB-SPC 321 receiving the noisy input image 
signal to generate a group of noisy input image parallel signals g(i,j;x,y) 
associated with the locally considered pixel and according to the predetermined 
pixels-window characteristics. The parallel signals g{i,j;x,y) generated at the 

10 PBSPC output 322 connected to a line 323 and the window binary signals 
M}J\x,y) at 320' are sent together to the mean value /j estimator 307 having 
an output 308 described by the above equations (9a) and (9b). In these 
equations, the term N is simply a count of selected pixels in the local window 
- which are similar to the considered pixel {x,y) within the tolerance of threshold 

15 value T. A selected-pixels counter 327 with signal input \v(ij;x,y) 320 can be 
done by appropriate adders to realize equation (9b) above. The counter output 
, signal at 328 represented in a few bits is sent to the mean value // estimator 307. 
The SAW-SNR further comprises a minimum-mean-square-enror filter generally 
designated at 329 receiving the noisy input image parallel signals g(i,j;x,y) at 

20 322, the segmented local window parallel signals w{i,J;x,y) at 330, the selected- 
pl.^' •■'s count signal N at 331 and the mean pixel value signal ju{x,y) at 332 to 
generate a noise-filtered output image signal f'{x,y) according to an input noise 
statistic signal at 314. More specifically, the filter 329 comprises a statistical 
calculator 312 receiving the above signals g(i,J,x,y), w{i, J;x,y) and N to either 

25 generate a standard deviation (SD) signal or a variance signal at 313. In order to 
reduce the inherent complexity of equation (8) above, the proposed calculator 312 
is preferably a standard deviation calculator yielding a SD value cr^(x,;;) at 313 
estimated by absolute deviation mean as follows: 
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(14) 

In the latter equation, N is again tiie number of selected similar pixels in the iQcal 
5 window. Moreover, depending on the noise distribution, an appropriate value for 
constant C can be chosen equal to about 1 .25 for additive Gaussian noise, or to 
about 1.15 for additive uniform noise. The filter 329 further comprises a weight 
calculator 319. The current SD crg{x,y) at 313 as given by equation (14) and the 
noise input SD o-„ at 314 are preferably applied to the weight calculator 319 
10 generating weight K{x,y) as already described by equation (5) above. Although 
less efficient, the statistical calculator 312 may also be a variance calculator 
implementing equation (8)' to generate a variance value crg^{x,y) in which case 
the noise input variance <r^ is fed to the weight calculator 319 to generate weight 
K{x,y) using same equation (5). In the case of white noise of constant variance 
15 o-^. Instead of a weight calculator 319. a lookup table (LUT) is preferably used, 
which is built by pre-calculating necessary weights K{x,y). In the latter case, the 
value of constant C in equation (14) can be chosen fixed and the input noise 
variance cr^ represented by a few bits can be entered by an end-user to obtain 

the desired noise reduction level. 

20 After proper delaying, the noisy image signal at 322 is applied in tum to an 

adder 309 included in the filter 329 through an input line 324. The adder output 
signal at 325 representing the current difference {g(x,y)-ju{x,y)) is weighted by 
the current weight K{x,y) signal at 315 by a multiplier 310 included in the filter 
329. The multiplier output 316 and the mean value /j{x,y) are applied together to 

25 an adder 311 included in the filter 329 to yield the filtered image signal f''(x,y) 
316 of the desired Single local Adaptive Window Spatial Noise Reducer (SAW- 
SNR) 318. 

It is worthwhile to note that, in addition to the usual noisy Input g(x,y) at 
301 and the filtered output f'{x,y) at 316, the SAW-SNR 318 has also an input 
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300 for a window characteristics data- (WIC) signal. This signal is used to select 
some window size and its relative position to the considered current pixel at the 
coordinates {x,y). In another words, the selected window is usually, but not 
absolutely necessary centered to the current pixel. Some pixel olfsets or different 
5 window sizes can be useful for a more sophisticated spatial noise reducer, which 
will be described later according to a second preferred embodiment of the present 
invention. 

Referring now to Fig. 4, there is illustrated a few examples of window 
characteristics relatively to the current pixel position. The window 401 is a 5x5 

10 square one centered to the current pixel 400, a centered square window being 
suitable for progressive image. The dotted window 402 is also a centered window 
of dimension 3x7, i.e., 3 lines and 7 columns, an horizontal rectangular window 
being suitable for interlaced signal. For the case of a single adaptive window 
spatial noise reducer, centered windows are recommended. Moreover, equations 

15 (7), (9) and (1 0) above show that, at least in a homogeneous region, the lai^er the 
window the better the result. Fig. 4 illustrates also two windows 403 and 404 that 
are not centered on the current pixel. The window 403 has one pixel being offeet 
to the left, while the window 404 has one pixel being offset to the right. Horizontal 
offset windows are suitable for economic purpose in a Parallel Multiple local 

20 Adaptive Window Spatial Noise Reducer (Parallel M-AW-SNR), which will be 
described later in detail with reference to Fig. 8. 

Before referring to Fig. 7, which illustrates a functional implementation 
block Qiuyram of the first embodiment in detail, in order to simplify and facilitate 
the presentation, let's consider now Fig. 6 that represents an example of a pixel- 

25 based sequential-to-parallel converter (PB-SPC) of 3x5 dimension. In order to 
create a local window for filtering or for segmentation, it is necessary to use a PB- 
SPC that converts a scanned image signal to multiple parallel signals 
conresponding to all pixel intensity values in the given window. The scanned 
image input signal gix,y) at 501 is simply applied to appropriate line and pixel 

30 delays in series. For a window of 3x5 dimension, it takes at least two line delays 
502, 504 and three (3) series of four (4) pixel delays 510-516, 520-526 and 530- 
536, respectively. In this example, if the window is centered, the cun-ent pixel is 
located at an output 523. The other output signals 501, 503, 505, 511, ...,513, 
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533 537, correspond to the current pixel neighbors in the window. Turning 

now to Fig. 6a. there is illustrated a graphic notation of a scalar product (SP) 

from two vectors a = (a^,a2,...,a„) at an input 611 and ^ = (ft,,&2v,6„) a* an 
input 612, according to the following relation: 

5 

SP =^.by^a,b, 

(15) 

wherein the summing is done over / for i = l,2,...,n. In the notation, n is the 

— > — > 

10 component number of the vectors a and b . The scalar product (SP) at 616 is 
done by a scalar multiplier 613. Some implementation details of the scalar 
multiplier are shown in Fig. 6b. It consists of n (illustrated with n = 3) parallel 
multipliers 613-1, 613-2,.., 613-n and an adder 615 of n multiplier results 614-1, 
614-2 61 4^ ». The Inputs of the z'* multiplier 61 3- z are the components a, 611- 

15 I and Z>,. 611-z of the respective vectors a and b. 

Referring now to Fig- 7, an implementation for the first embodiment of the 
proposed SAW-SNR basically described above with reference to in Fig.3 will be 
now explained in detail. The noisy input image g{x,y) at 70t is applied to an input 
PB-SPC 702 of dimension 3x3 as part of the low-pass filter represented at 302 in 

20 Fig. 3. The PB-SPC vector output at 717 is applied in turn to a SP 741 that also 
receives a vector of low pass filter coefficients at 740. Assuming that equation 
(12a) above describes the low pass filter, all component values of the coefficient 
vector at 740 are equal to unity (1). The proportional term 1/9 in equation (12a) 
can be further . absorbed by the threshold value in equation (13) above. 

25 Meanwhile, the output 718 of the PB-SPC 702, corresponding to the current pixel, 
is an appropriate delayed version of the input noisy image signal g{x,y). The SP 
output 703, corresponding to the low pass output signal 303 in Fig.3, is sent to a 
PB-SPC 704, corresponding to the PB-SPC 306 in Fig. 3, of desired window 
dimension in order to get the pixel intensity vector at 705 of the given local 

30 window. A single input 706 represents the current filtered pixel intensity output 
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signal g'{x,y). Let N,. being the window total pixel number and also the 
component number of the vector at 705 in which the signal component at 706 
conresponds to the current considered pixel intensity. The vector at 705 and the 
current component at 706 are then applied to a vector adder 707 as illustrated by 
5 a double circle, which in fact includes A^j. parallel adders, to calculate the Nj. 

differences (g'(i,J;x,y)-g'{x,y)) as required by equation (13) above. The vector 
adder output 708 is applied to a vector full-wave rectifier 739 necessary now for 
calculating \g*{i,J;x,y)-g'(x,y^ for ail / and j in the window. For segmentation 

purpose, the rectifier output vector at 740 and the threshold vector at 709 are sent 
10 to a vector adder 710, from which a resulting vector at output 711 is fed to a 

comparison detector 712. The detector output vector w at 713 composed of Nj. 
binary components {w{i,J;x,y)} is sent now to three (3) SP 715, 724 and 728. The 
SP 715 is simply provided as part of the selected similar pixel counter, and is 
provided with a second input 714 fed by a constant and unitary (1 ) vector. The SP 
15 output 716 represents the local selected similar pixel number N , corresponding 
to the current pixel intensity. Meanwhile, the delayed version of the input noisy 
signal g (x, y) at 718 is sent to a PB-SPC 719, con-esponding to the PB-SPC 321 
in Fig. 3, of the same desired window dimension than that of PB-SPC 704. The 

parallel output vector at 720 and the segmented window vector w at 713 are 
20 applied together to the SP 724 that yields at its output 735 the summing value of 
similar pixfc. ni^ensities in the local window. The total and local value signal at 735 
and the Jpcal number N signal at 716 are applied to a ROM or LUT 737 to get a 
local mean // at 721 . It is pointed out that a few bits can represent the value N . 
The ROM or LUT 737 is proposed to avoid an expensive division. In order to 
25 detenmine the local SD er^ of the noisy input image, the vector of Nj.. parallel 
windowed noisy pixels at 720 and the obtained local mean // at 721' are applied 
also to a vector adder 722. The vector adder output 723 is sent in turn to a vector 
full-wave rectifier 725 generating at 726 an output difference vector 
ig{hf>x>y)-Ax>y}} of Nj. components. The difference vector signals and the 

30 segmented window vector w signals are sent to the SP 728 that yields at the 
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output 729 the weighted sum" (^J^M{iJ;x,y)»i\g{iJ;x,y)-/j{x,y})) as 
necessary for equation (14) above. The multiplication by a constant C equal to 
about 1.25 for Gaussian noise and the division by N selected similar pixel 
number at 716 can be integrated in a ROM or LUT 731 generating at an output 

5 743 an estimated local SD cr^ of the noisy input image, which is fed with the SD 
tT„ of the input noise at 730 to a weight calculator 742 implementing equation (5) 
above. The current calculated weight output K{x,y) at 732 is used to weigh the 
current difference ig{x,y)-/i{x,y)) at 727 via a multiplier 733. The multiplier 
weighted output signal at 736 is sent to an adder 734. The above weighted current 

10 difference signal at 736 and the local mean /4x,y) at 721 , via an adder 734. give 
the noise-filtered output image signal f'{x,y) at 738. 

Referring now to Fig. 8, a second embodiment of the present invention in 
the form of a Parallel Multiple local Adaptive Window Spatial Noise Reducing 
apparatus (M-AW-SNR) as generated designated at 800 will be now described. 

15 Let g{x,y) be the noisy Image input signal at 801, which con-esponds to the same 
input signal at 301 in Fig. 3. The noisy signal is applied simultaneously to L 
parallel SAW-SNRs, respectively designated at 318-1 , 318-2,.. and 318-L . Each 
SAW-SNR 318, which was basically described above with reference to Fig. 3, is 
working now with a distinct set of window characteristics WIC fed at inputs 300-1 

20 to 300-X. The SAW-SNR outputs, 316-1 to 316-X, are added together via an 
adder 820 as part of an averaging unit 824. The adder output 821 is divided by L 
and then rounded by a calculator 822 included In the averaging unit 824. The 
result output 823 is also the desired final signal of the Parallel M-AW-SNR. It is to 
be understood that the L low pass filters included in the L parallel SAW-SNRs 

25 can be replaced by a single low pass filter 802 indicated in dotted lines in Fig. 8. 
The proposp Parallel M-AW-SNR configuration can be justified by its 
performance. Let hXx,y)be the i** SAW-SNR output. 318-i , defined as follows: 

hXx.y) = f{x,y)+r,.{x,y) 
30 (16) 
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The residual noisy component r.(xyy) is supposed to be non-con^elated to tlie 
clean image f(x^y). This supposition is valid at least in edge regions where noise 
can remain after applying a SAW-SNR. The con-elation between two components 
r^x^y) and rj{x,y) resulted from two different but overlapped windows with 
similar size, is supposed equal to followlngs: 

(17) 

The term cr^ denotes the variance of the residual SAW-SNR noise, and is the 
normalized cross-correlation between noisy components r,(x,y) and rj{x,y). Let 
JPMand y denoting respectively the perfomiance indices of a Parallel M-AW- 
SNR and a SAW-SNR. It can be shown that the improvement JjJPM is equal to: 

(18) 

The improvement has been verified experimentally even in the case of a SAW- 
SNR, which utilizes, as window, the union of all individual ones in a given Parallel 
M-AW-SNR. The proposed Parallel M-AW-SNR is an averaging configuration that 
can also be just!" i by its simplicity. In fact, it would be much more complicated to 
obtain an optimum linear combination with L SAW-SNRs output images. The 
Parallel M-AW-SNR configuration is composed of L parallel SAW-SNRs as 
previously described. It could be also possible to utilize SAW-SNRs in series (not 
shown). If the residual noise after each SAW-SNR is supposed to be still non- 
correlated to the clean image f{x,y). It can be theoretically shown that the 
perfomnance indicia JSM associated with a Serial M-AW-SNR is given by the 
following equation: 
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JSM = cr}(x,y)»cr;{x,y)/(o-}ix,y)+L»cr^) 

(19) 

In equation (19), the temis cT}{x,y) and tr,^ denote respectively the local clean 
5 image variance and the original input noise variance. Hence, for the Serial M-AW- 
SNR, a theoretical improvement of. 

J/JSM = (c7j{x,y)+Lo-l)/(i7}{x,y)+ o-l)> 1 
(20) 

10 

over the single SAW-SNR is possible. However, tfiis expression shows that. In 
edge regions, the improvement is not necessary appreciable. Moreover, serial 
configuration requires estimation of each individual residual noise, which imply a 
costly hardware implementation. Therefore, the Parallel M-AW-SNR is 

15 recommended over the Serial M-AW-SNR. 

Turning now to Fig. 9, a third preferred embodiment of the present 
invention in the form of a Single local Adaptive Window Spatial Noise Reducer 
with controllable noise statistic estimator 900 will be now described. The noisy 
image signal g(x,y) is applied at 301, as usual, to the basic SAW-SNR 318 

20 generating the noise-filtered output image signal f'{x,y) at 316. At the same 
time, the noisy image is sent also to a High-Pass Two-Dimensional Filter HP2DF 
901 , which extracts only very high vertical and horizontal frequency components 
in the input image. The filter band-pass bandwidth is chosen such that the filter 
output 902 contains mainly noise components, but not clean image. Justification 

25 for the choice of a HP2DF can be explained generally by the wide-band nature of 
noise. The utilized HP2DF is preferably a diamond filter, an example of impulse 
response function thereof being as follows: 
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(21) 



The noisy horizontal/vertical high-spatial frequency image signal at 902 is fed to a 
PB5PC 911 to generate at output 913 a group of noisy horizontal/vertical high- 
spatial frequency image parallel signals associated with the locally considered 
pixel and according to the set of predetermined pixels-window characteristics. 
The BPSPC output 913 with the segmented local window parallel signals 
w{i,j;x,y) at 320 and the selected-pixels count signal iSTat 328 available from 
the SAW-SNR 318 are sent to a statistic calculator 912 to generate a resulting 
noise statistic signal associated with the locally considered pixel. As explained 
before regarding the first prefen-ed embodiment, while the statistic calculator 912 
is preferably a SD calculator generating a SD resulting signal cr^{x,y) at 904,, it 
could be a variance calculator directly generating a variance resulting signal 
iTf(x,y) at 904. The calculator 912 is similar to the calculator 312 described 
before with reference to Fig. 3, but provided with a built-in mean value // 
estimator. The calculator resulting signal at 904 is appii«=d -t the input of a look- 
up table LUT 905 as part of a noise statistic estimator unit 915 adapted to the 
specific application, as will be now explained in detail. The LUT 905 estimates at 
its output 907, a mean value of local noise input SD o-„Xx,y) (or variance 
^(x,y))- The LUT Input-output relationship between the two local standard 
deviations o-Xx,y) (or variance cr;{x,y)) and o-„{x,y) (or variance al{x,y)) can 

be described by the following method. Let consider the linear portion in Eq.5 
expressed by : 



25 
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(5b) 

wherein the unknown additive noise variance £r^{x,y) is supposed now to be 
5 varying. It is thus necessary to pre-estimate this variance value for each pixel 
located at (x,;'). 

In many situations where the processing is well defined, such as for NTSC 
or PAL encoding/decoding and DCT based compression/decompression, an 
available original and clean test signal f{x,y) can be used for noise pre-learnlng. 

10 Fig. 9 illustrates partly a proposed configuration at 960 used for performing an off- 
line noise variance pre-estimation. The original test signal f(x,y)at 950 is applied 
to the above-mentioned processing at 951 which gives a test noisy image signal 
g{x,y) at 952. The additive test noise signal n{x,y) ai 954 is then obtained by the 
difference (g{x,y)-f{x,y)) provided by an adder 953 and is sent in tum to a 

1 5 statistic calculator 955 similar to the calculator 912. The test noise SO {x, y) (or 
the test noise variance crl{x,y)) estimation is done in the same context of that of 
the signal g{x,y) in the proposed SAW-SNR 318, with the segmented window 
parallel signals M{i,j;x,y) at 320 and the selected-pixels count signal Nat 328. 
In words, for a considered pixel at {x,y), one obtains a pair of SD values 

20 {(rXx,yXo-„{x,y)) (or a pair of variance values (eT^{x,yXai{x,y))). For the whole 
test picture or set of test pictures, a given value of cr^ (or ) can have many 
resulted values of a^iorcrl,). In order to obtain a unique input-output relationship 
for the LUT 905, it is necessary, for a given cr, (or cr^ ) , to define a single value 
cr^ representing all possible values of cr^. For the preferred SD calculation, 

25 proposed estimations for are as follows: 

cr„ = mean ( , given a value of cr, ); . 
(22) 

or 
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<T^ - mode ( , given a value of cr^ ) 
(23) 

The estimation (22) or (23) can be done then on an off-line basis by a data 
5 storage and estimation device 957. The input-output result {o-/,cr^) at 904 and 

958 respectively, permits the establishment of a pre-calculated LUT 905 for real 
time processing involving an unknown image. If the memory LUT 905 is large 
enough, some controllable bits can be fed at input 903 representing a learning or 
functional condition, for example for NTSC, PAL or 12Mbit MPEG. The main 

10 requirement of the method is the prior knowledge of the processing to create the 
noisy image g{x,y) from the dean image f{x,y). The LUT output signal 
cr,„(x,y)at 907 could be sent directly (not shown) to the input 314 of the SAW- 
SNR 318 as local SD of the input noise. However, the estimated value o-^{x,y) in 
equations 22 or 23 is only a representative one and is not necessary always good 

15 for all spatial varying image conditions. In such cases, the noise statistic estimator 
unit 915 preferably comprises a conditional weighting unit 909 which could be 
another LUT that receives the signal a-„{x,y) at 907 and which is controlled, in 
turn, by the output 910 of a condition detector 908. The condition detector is 
driven by the input noisy image signal g{x,y) through line 301'. Depending on the 

20 specific application nature, the condition detector 908 classifies the current pixel' 
as belonging to some specific regions such as edge regions, flat regions, near 
edge near flat regions, texture regions etc., and accordiiigly applies an 
appropriate weight or function at 910 to the mean value a-^{x,y) fed at 907 for 
each region. As an example, for the case of ringing noise, the conditional 

25 weighfing output can be (y^*o-„{x,y) in contour or texture regions, 2»cr^{x,y) 

in near edge near flat regions, {y^»a-„{x,y) in flat regions (to protect small 
details that does not necessarily create the ringing noise) and cr„, {x,y) elsewhere. 
The conditional weighting output Is then sent to the SAW-SNR input 314 as local 
SD (or variance) of the input noise. It is to be understood.that, for specific noise 
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such as the coding block effect, the proposed method may be used provided 
appropriate specific conditional techniques and data are applied. 
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We claim; 

1. An adaptive spatial noise reducer (318) for reducing noise In a noisy input 
image signal comprising: 

a low-pass filter (302) receiving said noisy input image signal to generate a 
noisy low-spatial frequency Image signal; 

a first pixel-based serial-to-parallel converter (306) receiving the noisy low- 
spatial frequency image signal to generate a group of noisy low-spatial frequency 
image parallel signals associated with a locally considered pixel and according to 
predetermined pixels-window characteristics; 

a pixel-based local window segmentation processor (304) comparing 
values of the noisy low-spatial frequency image parallel signals associated with 
pixels included within the window with the locally considered pixel value to 
generate segmented local window parallel signals associated with selected pixels; 
^^^-^a^^c^ (327J^neratihg a selected-pixels count signal; 

a second pixel-based serial-to-parallel converter (321) receiving the noisy 
input image signal to generate a group of noisy input image parallel signals 
associated with the locally considered pixel and according to the predetermined 
pixels-window characteristics; 

a mean estimator (307) combining the noisy input image parallel signals 
with th^ segmented local window parallel signals and the selected-pixels count 
signal to generate a mean pixel value signal associated with the locally 
considered pixel; 

a minimum-mean-square-error filter (329) receiving the noit.^ nput image 
parallel signals, the segmented local window parallel signals, the selected-pixels 
count signal and the mean pixel value signal to generate a noise-filtered output 
image signal according to an input noise statistic signal. 

2. An adaptive noise reducer (318) according to claim 1, wherein values of 
said segmented local window parallel signals are given by: 




wherein: 
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g'{i,JyX,y) is said values of me noisy low-spatial frequency image parallel 
signals associated with pixels included witiiin the window with 
i = -k,...,+lj = -m,...,+n, said window having dimensions of (^+/)x(m + n), 
k,l,m,n being appropriate positive integers ; 

g'{x,y) is said locally considered pixel value; and 

r is a predetermined threshold value. 

f 

3. An adaptive noise reducer (318) according to claim 2, wherein a value of 
said mean pixel value signal is given by: 

with N^Y^^^'J'^^-y) 
wherein; 

gi}J\x,y) are values of said group of noisy input image parallel signals; 

and 

N \sa value of said selected-pixels count signal. 

4. An adaptive noise reducer (318) according to claim 1, wherein said input 
noise statistic signal is an input noise variance signal, said minimum-mean- 
square-error filter (329) including: 

a variance calculator (312) for generating an estimated variance signal from 
said noisy input image parallel signals, said segmented local window parallel 
signals, said selected-pixels count signal and said mean pixel value signal; 

a weight calculator (319) for generating a weight signal from the estimated 
variance signal and the input noise variance signal; 

a first adder (309) having an inverting input receiving said mean pixel value 
signal and a positive input receiving the noisy input signal associated with the 
locally considered pixel to generate a difference signal; 

a multiplier (310) receiving the weight signal and the difference signal to 
generate a weighted difference signal; 
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a second adder (311) having a first positive input receiving the mean pixel 
value signal and a second positive input receiving the weighted difference signal 
to generate said noise-filtered output image signal. 

5. An adaptive noise reducer (318) according to claim 1, wherein said input 
noise statistic signal is an input noise standard deviation signal, said minimum- 
mean-square-error filter (329) including: 

a standard deviation calculator (312) for generating an estimated standard 
deviation signal from said noisy input image parallel signals, said segmented local 
window parallel signals, said selected-pixels count signal and said mean pixel 
value signal; 

a weight calculator (319) for generating a weight signal from the estimated 
standard deviation signal and the input noise standard deviation signal; 

a first adder (309) having an inverting input receiving said mean pixel value 
signal and a positive input receiving the noisy input signal associated with the 
locally considered pixel to generate a difference signal; 

a multiplier (310) receiving the weight signal and the difference signal to 
generate a weighted difference signal; 

a second adder (311) having a first positive input receiving the mean pixel 
value signal and a second positive input receiving the weighted difference signal 
to generate said noise-filtered output image signal. 

6. An adaptive noise reducer (318) according to claim 5, wherein . . 'ues of 
said segmented local window parallel signals are given by: 

elsewhere 

wherein: 

is said values of the noisy low-spatial frequency image parallel 
signals associated with pixels included within the window with 
i = j = -.m,...,+;2 , said window having dimensions of (A: + /)x {jn + w) , 

kj,m,n being appropriate positive integers ; 

g* ix, y) is said locally considered pixel value; 
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r is a predetermined threshold value; 

wherein said mean pixel value signal is defined by: 

with N==^^w{i,J;x,y) 
wherein: 

g{ij;x,y) are values of said group of noisy input image parallel signals; 

and 

is a value of said selected-pixels count signal; and wherein a value of 
said estimated standard deviation signal is given by: 

7, An adaptive noise reducer (318) according to claim 1 , further comprising: 
a controllable noise statistic estimator (900) including: 

a high-pass two-dimensional filter (901) receiving said noisy input 
image signal to generate a noisy horizontal/vertical high-spatial frequency 
image signal; 

a third pixel-based serial-to-parallel converter (911) receiving said 
horizontal/vertical high-spatial frequency image signal to generate a group 
of noisy horizontal/vertical high-spatial frequency image parallel signals 
associated with the locally considered pixel and according to said set of 
predetermined pixels-window characteristics; 

a statistic calculator (912) combining the noisy horizontal/vertical 
high-spatial frequency image parallel signals with said segmented local 
window parallel signals and said selected-pixels count signal to generate a 
resulting noise statistic signal associated with the locally considered pixel; 

a noise statistic estimator unit (915) generating said input noise 
statistic signal from the resulting noise statistic signal. 

8. An adaptive noise reducer (318) according to claim 7, wherein values of 
said segmented local window parallel signals are given by: 



\P» elsewhere 
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wherein: 

g*{i,j;x,y) is said values of the noisy low-spatial frequency image parallel 
signals associated with pixels included within^ the window with 
2 = y=i-m,... said window having dimensions of (A: + /)x (777 + 71), 

kj,m,n being appropriate positive integers ; 

g*{x,y) is said locally considered pixel value; and 

r is a predetermined threshold value. 

9. An adaptive noise reducer (318) according to claim 8, wherein a value of 
said mean pixel value signal is given by: 

wherein: 

g{Uj;x,y) are values of said group of noisy input image parallel signals; 

and 

iV^ is a value of said selected-pixels count signal. 

10. An adaptive noise reducer (318) according to claim 7, wherein said input 
noise statistic signal is an input noise variance signal, said controllable noise 
statistic estimator (900) is a controllable noise variance estimator, said statistic 
calculator (912) is a variance calculator, said resulting noise statistic signal is a 
resulting noise variance signal, said noise statistic estimator unit (915) is a noise 
variance estimator unit. 

11. An adaptive noise reducer (313.) according to claim 10, wherein said noise 
variance estimator unit (915) incFudes?^"^" z^.' 

a noise mean variance estimator (905) receiving said input resulting noise 
variance signal to generate a mean variance signal; 

a condition detector (908) receiving said noisy input image signal to detect 
a spatial characteristic of said locally considered pixel; 
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a weighting device (909) operatively connected to Xhe condition detector for 
combining the mean variance signal with a weight value corresponding to a 
detected spatial characteristic to generate said input noise variance signal. 

12. An adaptive noise reducer (318) according to claim 7. wherein said Input 
noise statistic signal is an input noise standard deviation signal, said controllable 
noise statistic estimator (900) is a controllable noise standard deviation estimator, 
said statistic calculator (912) is a standard deviation calculator, said resulting 
noise statistic signal is a resulting noise standard deviation signal, said noise 
statistic estimator unit (915) is a noise standard deviation estimator unit. 

13. An adaptive noise reducer (318) according to claim 12, wherein values of 
said segmented local window parallel signals are given by: 

l®» elsewhere 

wherein: 

g^iiyjix.y) is said values of tlie noisy low-spatial frequency image parallel 
signals associated with pixels included within the window with 
/ = -/:,...,+/;7 = ~m,...,+7? , said window having dimensions of {k-¥l)x{m + n), 
kj,m,n being appropriate positive integers ; 

g*{x,y) is said locally considered pixel value; 

r is a predetermined threshold value; 

wherein said mean pixel value signal is defined by: 

with N = Y,Yj^^J^-^-y) 

wherein: 

giij\x,y) are values of said group of noisy input image parallel signals; 
N \s a value of said selected-pixels count signal; and wherein a value of 
said estimated standard deviation signal is given by: 
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14. An adaptive noise reducer (318) according to claim 12, wherein said noise 
standard deviation estimator unit (915) includes: 

a noise mean standard deviation estimator (905) receiving said input 
resulting noise standard deviation signal to generate a mean standard deviation 
signal; 

a condition detector (908) receiving said noisy input image signal to detect 
a spatial characteristic of said locally considered pixel; 

a weighting device (909) operatively connected to the condition detector for 
combining the mean standard deviation signal with a weight value corresponding 
to a detected spatial characteristic to generate said input noise standard deviation 
signal. 

15. An adaptive apparatus (800) for spatially reducing noise in a noisy input 
image signal comprising a plurality of parallel-connected adaptive spatial noise 
reducers (318-1, ...,318-1-) as defined in claim 1, wherein each said noise reducer 
is associated with a distinct set of said predetermined pixels-window 
characteristics and each said noise reducer receives said noisy input image signal 
to generate a corresponding said noise-filtered output image signal, said 
apparatus further comprising an averaging unit (824) receiving each said noise- 
filtered output image signal at a corresponding positive input thereof to generate a 
resulting noise-filtered output image signal. 

16. An adaptive apparatus (800) for spatially reducing noise in a noisy inpu. 
image signal comprising a plurality of parallel-connected adaptive spatial noise 
reducers (318-1,...,318-L) as defined in claim 1, wherein there is only one said 
low-pass filter (802) shared by all said noise reducers, each said noise reducer 
being associated with a distinct set of said predetermined pixels-window 
characteristics, each said noise reducer receiving said noisy low-spatial frequency 
image signal to generate a corresponding said noise-filtered output image signal, 
said apparatus further comprising an averaging unit (824) receiving each said 
noise-filtered output image signal at a corresponding positive input thereof to 
generate a resulting noise-filtered output image signal. 
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17. An apparatus (800) according to claim 15 or 16, wherejn values of said 
segmented local window parallel signals are given by: 



elsewhere 



wherein: - 
g*iij\^,y) *s said values of tlie noisy low-spatiaf frequency image parallel 
signals associated witli pixels included within the window with 
z = J = , said window having dimensions of (/: + /)x (m + n) , 

k,Um,n being appropriate positive integers characterizing said distinct set of 
predetermined pixels-window characteristics; 

^"(jc,;;) is said locally considered pixel value; 

r is a predetermined threshold value; and 

wherein a value of said mean pixel value signal is given by: 

wherein: 

g{i,j;x,y) are values of said group of noisy input image parallel signals; 

and 

N \sa value of said selected-pixels count signal. 

18. An adaptive method for spatially reducing noise in a noisy input image 
signal comprising the steps of: 

i) filtering said noisy input image signal to generate a noisy low-spatial 
frequency image signal; 

ii) converting the noisy low-spatial frequency image signal to a group of 
noisy low-spatial frequency image parallel signals associated with a locally 
considered pixel and according to a set of predetermined pixels-window 
characteristics; 

iii) comparing values of the noisy low-spatial frequency image parallel 
signals associated with pixels included within the window with the locally 
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considered pixel value to generate" segmented local window parallel signals 
associated with selected pixels; 

iv) generating a selected-pixels count signal; 

v) converting the noisy input image signal to a group of noisy input 
image parallel signals associated with the locally considered pixel and according 
to the set of predetermined pixels-window characteristics; 

vi) combining the noisy input image parallel signals with the segmented 
local window parallel signals and the selected-pixels count signal to generate a 
mean pixel value signal associated with the locally considered pixel; and 

vii) processing the noisy input image parallel signals with a minimum- 
mean-square-error filter using the segmented local window parallel signals, the 
selected-pixels count signal and the mean pixel value signal to generate a noise- 
filtered output image signal according to an input noise statistic signal. 

19. A method according to claim 18, wherein values of said segmented local 
window parallel signals are given by: 



wherein: 

g*{iyj;x,y) is said values of the noisy low-spatial frequency image parallel 
signals associated with pixels included within the window with 
/ = J = -m,...,+72, said window having dimensions of (ifc + /)x(m + w), 

kj,m,n being appropriate positive integers ; 

S*{xyy) is said locally considered pixel value; and 

r is a predetermined threshold value. 

20. A method according to claim 19, wherein a value of said mean pixel value 
signal is given by: 





* with N = Y^a^^^J'^^^y) 



wherein: 
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g{i,jix,y) are values of said group of noisy input image parallel signals; 
AT is a value of said selected-pixels count signal. 

21. A method according to claim 18,.wherein said input noise statistic signal is 
an input noise variance signal, said minimum-mean-square-error algorithm 
including the steps of: 

a) generating an estimated variance signal from said noisy input image 
parallel signals, said segmented local window parallel signals, said selected-pixels 
count signal and said mean pixel value signal; 

b) generating a weight signal from the estimated variance signal and 
the input noise variance signal; 

c) subtracting said mean pixel value signal from the noisy input signal 
associated with the locally considered pixel to generate a difference signal; 

d) multiplying the weight signal with the difference signal to generate a 
weighted difference signal; 

e) adding the mean pixel value signal and the weighted difference 
signal to generate said noise-filtered output image signal. 

22. A method according to claim 18, wherein said input noise statistic signal is 
an input noise standard deviation signal, said minimum-mean-squarererror 
algorithm including the steps of: 

a) generating an estimated standard deviation signal from said noisy 
i.iput image parallel signals, said segmented local window parallel signals, said 
selected-pixels count signal and said mean pixel value signal; 

b) generating a weight signal from the estimated standard deviation 
signal and the input noise variance signal; 

c) subtracting said mean pixel value signal from the noisy input signal 
associated with the locally considered pixel to generate a difference signal; 

d) multiplying the weight signal with the difference signal to generate a 
weighted difference signal; 

e) adding the mean pixel vialue signal and the weighted difference 
signal to generate said noise-filtered output image signal. 
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23. A method according to claim 18, wlierein values of said segmented local 
window parallel signals are given by: 



g*{i,j',x,y) is said values of the noisy low-spatiaNrequency image parallel 
signals associated with pixels included within the window with 
r = -*:,...,+/;7 = -m,...,+n, said window having dimensions of (A-h/)x(w + «), 
kj,m,n being appropriate positive integers ; 

g*{x,y) is said locally considered pixel value; 

r is a predetermined threshold value; 

wherein said mean pixel value signal is defined by: 

with N = Y.^w{iJ;x,y) 
wherein: 

s{iJ\x,y) are values of said group of noisy Input image parallel signals; 
iV^ is a value of said selected-pixels count signal; and wherein a value of 
said estimated standard deviation signal is given by: 



24. A method according to claim 18, further comprising the steps of: 

viii) repeating said steps ii) to vii) according to at least one further distinct 
set of pixels-window characteristics to generate a further noise-filtered output 
image signal according to said input noise statistic signal; and 

ix) averaging said output image signals to generate a resulting noise- 
filtered output image signal. 

25. A method according to claim 24, wherein values of said segmented local 
window parallel signals are given by: 




wherein: 
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wherein: 

g'{i,j;x,y) is said values of the noisy low-spatial frequency image parallel 
signals associated with pixels included within the window with 
i = -k,...,+hj = -m,...,+n, said window having dimensions of {k + l)x(m + n), 
k,l,m,n being appropriate positive integers characterizing said distinct set of 
predetermined pixels-window characteristics; 

g'{x,y) Is said locally considered pixel value; 

r is a predetermined threshold value; and 

wherein a value of said mean pixel value signal is given by: 

with isr = 2^ J] y; X, 3^) 
wherein: 

g{},ji,x,y) are values of said group of noisy input image parallel signals; 

iand 

AT is a value of said selected-pixels count signal. 

I 

26. A method according to claim 18, further comprising between said 
combining step vi) and processing step vii) the steps of: 

a) filtering said noisy input image signal to generate a noisy 
horizontal/vertical high-spatial frequency image signal; 

b) converting the noisy horizontal/vertical high-spatial frequency image 
signal to a group of noisy horizontal/vertical high-spatial frequency image parallel 
signals associated with the locally considered pixel and according to said set of 
predetermined pixels-window characteristics; 

c) combining the noisy horizontal/vertical high-spatial frequency Image 
parallel signals with said segmented local window parallel signals and said 
selected-pixels count signal to generate a resulting noise statistic signal 
associated with the locally considered pixel; and 

■^l^xmiig^)-.^--^- generating said input noise statistic signal from the resulting noise 
statistic signal. 
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27- A method according to claim 26, wherein values of said segmented local 
window parallel signals are given by: 

[Py elsewhere 

wherein: 

g^{hj',x,y) is said values of the noisy low-spatial frequency image parallel 
signals associated with pixels included within the window with 
/ = -^,».,+/;j = -m,...,+;2, said window having dimensions of {k + l)x{m-^n), 
kj,m,n being appropriate positive integers ; 

g*{x,y) is said locally considered pixel value; and 

T is a predetermined threshold value. 

28. A method according to claim 27, wherein a value of said mean pixel value 
signal is given by: 

with N = Y.^w{UJ;x,y) 
wherein: 

gihJix,y) are values of said group of noisy input image parallel signals; 
N \sa value of said selected-pixels count signal. 
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(57) Abstract: The basic configuration of Single local Adaptive Window Spatial Noise Reducer (SAW-SNR 318) is based on a 
preliminary de-noising low-pass filter followed by homogenous region segmentation to the considered pixel in a given local win- 
dow. The configuration is composed also of an adaptive local mean estimator (307), an adaptive local statistic estimator (312) which 
is preferably an economic standard deviation (SD) estimator and finally, a minimum-mean-square-error (MMSE) based de-noising 
technique. The proposed segmentation configuration outperforms existing spatial noise reducers in term of subjective and objective 
performances, in term of edge preservation, noise reduction in both homogenous regions or picture edges and Peak Signal to noise 
Ratio (PSNR). A second configuration in the form of a Parallel Multiple local Adaptive Window Spatial Noise Reducing appara- 
tus (Parallel M-AW-SNR), is a combination of several basic reducers (312) which implements different segmented windows. The 
M-AW-SNR, which is the less complex configuration for multiple spatial noise reducers, reduces further residual noise as compared 
to the basic configuration of SAW-SNR (312). A third configuration combines the basic configuration of SAW-SNR (312) with a 
controllable noise variance estimator This generic configuration allows an adaptive local conu-ol of noise reduction level, which can 
be useful for some correlated noise such as ringing noise in DCT-based decompressed images or cross-luminance noise in composite 
decoded images. 
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